Intermediate Data Engineer

About

Description

NTT DATA South Africa is seeking an Intermediate Data Engineer to design, build, and maintain advanced data solutions on the Microsoft Azure Data Platform. The role focuses on developing efficient data pipelines, supporting analytics and reporting functions, and ensuring the integrity, security, and performance of enterprise data assets. You will collaborate with cross-functional data teams to deliver reliable, scalable data systems that drive business insight and innovation

Responsibilities

• Design and implement scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines
• Ingest structured/unstructured data from APIs, databases, Azure Event Hubs, and external systems
• Build and maintain data flows within the Azure Data Lake using the Medallion Architecture (Bronze, Silver, Gold layers)
• Develop efficient data models and schemas to support reporting and analytics
• Implement Delta Lake and Parquet storage formats for optimized data processing
• Collaborate with architects to refine and improve data platform standards
• Develop and maintain data validation and profiling routines using PySpark, Databricks, and ADF
• Track data lineage and metadata using Microsoft Purview
• Ensure compliance with GDPR, ISO 27001, and other data governance standards
• Tune SQL and Spark jobs for performance and cost efficiency
• Monitor workloads with Azure Monitor and Log Analytics
• Continuously enhance pipeline reliability and automation
• Work with analysts and data scientists to translate business requirements into technical solutions
• Participate in Agile/Scrum teams and contribute to code reviews, documentation, and sprint planning

Qualifications

• Bachelor’s Degree in Computer Science, Information Technology, or a related field

Application instructions:

• CLICK ON THE "APPLY NOW" BUTTON TO APPLY